Information processing apparatus, control method, and program

ABSTRACT

There is provided an information processing apparatus, control method, and program that allow for recognition of a state of an arm on the basis of determination of whether the information processing apparatus is worn on the left arm or the right arm, the information processing apparatus including: a determination unit configured to determine whether the information processing apparatus is worn on a user&#39;s right arm or left arm; a recognition unit configured to recognize a state of the arm; and a control unit configured to perform predetermined control on a device included in the information processing apparatus according to the recognized state of the arm. The recognition unit switches settings of a parameter which is used in the recognition of the state of the arm, according to a result of the determination by the determination unit.

CROSS REFERENCE TO PRIOR APPLICATION

This application is a continuation of U.S. patent application Ser. No.16/410,469 (filed on May 13, 2019), which is a continuation of U.S.patent application Ser. No. 15/119,054 (filed on Aug. 15, 2016 andissued as U.S. Pat. No. 10,345,761 on Jul. 9, 2019), which is a NationalStage Patent Application of PCT International Patent Application No.PCT/JP2015/053564 (filed on Feb. 9, 2015) under 35 U.S.C. § 371, whichclaims priority to Japanese Patent Application No. 2014-055052 (filed onMar. 18, 2014), which are all hereby incorporated by reference in theirentirety.

TECHNICAL FIELD

The present disclosure relates to information processing apparatuses,control methods, and programs.

BACKGROUND ART

Mobile terminals that are worn on an arm like wristwatches (alsohereinafter referred to as “wristband terminals”) have recently beenbecoming widespread.

For input to wristwatch terminals for operation, a touchscreen providedat the top of the terminal is mainly used. Alternatively, for example,Patent Literature 1 below discloses a technique relating to wristwatchterminals with which gestures such as “hold,” “release.” and the likecan be recognized and input as commands while the wristwatch terminal isworn on a wrist.

CITATION LIST Patent Literature

Patent Literature 1: JP 2002-358149A

SUMMARY OF INVENTION Technical Problem

However, the small size of wristwatch terminals may make it difficult toperform input operations on the touchscreen. In addition, wristwatchterminals are worn on an arm, which makes touchscreen operationsunsteady compared to smartphones, which can be held by a hand.

Moreover, wristwatch terminals are worn on an arm, and therefore, it isnecessary to use the other arm in order to operate the touchscreen,i.e., both arms are required for touchscreen operations. Therefore, whenthe other hand is occupied, the wristwatch terminal cannot be operated.

In addition, although the above conventional techniques disclose thatgestures such as “hold,” “release,” and the like are input as commands,none of them mention that a state of an arm which is associated with thepurpose of an operation (the purpose of use) is recognized. For example,during viewing of the display screen, calling, and shooting using awristwatch terminal, an arm on which the wristwatch terminal is worn isin different states. If different intuitive input operations can beprovided according to such different states, the usability of awristwatch terminal is further improved. The detection value of a motionsensor or the like used for recognizing such arm states differsdepending on whether a wristwatch terminal is worn on the user's rightarm or left arm. However, in the conventional art, attention has notbeen paid to whether a wristwatch terminal is worn on the left arm orthe right arm.

With this in mind, the present disclosure proposes an informationprocessing apparatus, control method, and program that allow forrecognition of a state of an arm on the basis of determination ofwhether the information processing apparatus is worn on the left arm orthe right arm.

Solution to Problem

According to the present disclosure, there is provided an informationprocessing apparatus including: a determination unit configured todetermine whether the information processing apparatus is worn on auser's right arm or left arm; a recognition unit configured to recognizea state of the arm; and a control unit configured to performpredetermined control on a device included in the information processingapparatus according to the recognized state of the arm. The recognitionunit switches settings of a parameter which is used in the recognitionof the state of the arm, according to a result of the determination bythe determination unit.

According to the present disclosure, there is provided a control methodincluding: determining whether an information processing apparatus isworn on a user's right arm or left arm; switching settings of aparameter used in recognition of a state of the arm according to aresult of the determination, and recognizing the state of the arm; andperforming predetermined control on a device included in the informationprocessing apparatus according to the recognized state of the arm.

According to the present disclosure, there is provided a program forcausing a computer to function as: a determination unit configured todetermine whether an information processing apparatus is worn on auser's right arm or left arm; a recognition unit configured to recognizea state of the arm; and a control unit configured to performpredetermined control on a device included in the information processingapparatus according to the recognized state of the arm. The recognitionunit switches settings of a parameter which is used in the recognitionof the state of the arm, according to a result of the determination bythe determination unit.

Advantageous Effects of Invention

As described above, according to the present disclosure, a state of anarm can be recognized on the basis of determination of whether aninformation processing apparatus is worn on the left arm or the rightarm.

Note that the effects described above are not necessarily limited, andalong with or instead of the effects, any effect that is desired to beintroduced in the present specification or other effects that can beexpected from the present specification may be exhibited.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram showing an external appearance and configuration ofan information processing apparatus.

FIG. 2 is a diagram for describing an information processing apparatusas it is worn.

FIG. 3 is a block diagram showing a basic configuration of aninformation processing apparatus according to this embodiment.

FIG. 4 is a diagram for describing determination of whether aninformation processing apparatus is worn on the right arm or the leftarm, which is performed using an acceleration sensor.

FIG. 5 is a diagram for describing states 1 to 3.

FIG. 6 is a state transition diagram showing transitions between states1 to 3.

FIG. 7 is a diagram showing a list of control of devices in states 1 to3.

FIG. 8 is a diagram showing a list of other control of devices in states1 to 3.

FIG. 9 is a diagram for describing state 1, state 2, and state 4.

FIG. 10 is a state transition diagram showing transitions between state1, state 2, and state 4.

FIG. 11 is a diagram showing a list of control of devices in state 1,state 2, and state 4.

FIG. 12 is a diagram showing a list of other control of devices in state1, state 2, and state 4.

FIG. 13 is a diagram for describing examples of rotation of an arm.

FIG. 14 is a diagram for describing state 1, state 2, and state 5.

FIG. 15 is a diagram showing a display screen example of an informationprocessing apparatus according to a comparative example.

FIG. 16 is a diagram showing a display screen example where aninformation processing apparatus according to this embodiment is worn onthe left arm.

FIG. 17 is a diagram showing a display screen example where aninformation processing apparatus according to this embodiment is worn onthe right arm.

FIG. 18 is a diagram for describing a detectable region of a touchsensor.

FIG. 19 is a diagram for describing assignment of a zoom operationregion when an information processing apparatus according to thisembodiment is worn on the left arm.

FIG. 20 is a diagram showing a display screen example where aninformation processing apparatus according to this embodiment is worn onthe right arm.

FIG. 21 is a diagram for describing state 1, state 2, and state 6.

FIG. 22 is a state transition diagram showing transitions between state1, state 2, and state 6.

FIG. 23 is a diagram showing a list of control of devices in state 1,state 2, and state 6.

FIG. 24 is a diagram showing a list of other control of devices in state1, state 2, and state 6.

DESCRIPTION OF EMBODIMENT(S)

Hereinafter, (a) preferred embodiment(s) of the present disclosure willbe described in detail with reference to the appended drawings. In thisspecification and the drawings, elements that have substantially thesame function and structure are denoted with the same reference signs,and repeated explanation is omitted.

Also, description will be provided in the following order.

1. Overview of Information processing apparatus according to Embodimentof Present Disclosure

2. Basic Configuration

3. Device Control Examples according to State

3-1. Device Control Examples in State 1, State 2, and State 3

3-2. Device Control Example in State 1, State 2, and State 4

3-3. Device Control Example during Wearing on Right Arm (State 5)

3-4. Device Control Example in State 6

4. Conclusion

1. Overview of Information Processing Apparatus According to Embodimentof Present Disclosure

An overview of an information processing apparatus according to anembodiment of the present disclosure will be described with reference toFIGS. 1 and 2. FIG. 1 is a diagram showing an external appearance andconfiguration of the information processing apparatus. FIG. 2 is adiagram for describing the information processing apparatus as it isworn.

As shown in FIGS. 1 and 2, the information processing apparatus 10according to this embodiment is a wearable terminal that is worn on anarm 200 or a wrist of the user, and is also referred to as awristwatch/wristband terminal. With the information processing apparatus10, the user can immediately check and operate information displayed onthe display screen without the action of removing the informationprocessing apparatus 10 from a bag or a pocket.

The information processing apparatus 10 is provided with, on an outercircumferential surface thereof, a touch panel display (hereinafterreferred to as a touchscreen) 12 functioning as a display unit and anoperation unit, speakers 15 a and 15 b, microphones (also hereinafterreferred to as mics) 16 a and 16 b.

The touchscreen 12 is provided in, for example, a region which is aportion of the entire circumference of the information processingapparatus 10 so that it is easy for the user to perform a touchoperation on the touchscreen 12. Note that the present disclosure is notlimited to this, and the touchscreen 12 may be provided along the entirecircumference of the information processing apparatus 10.

The display unit function of the touchscreen 12, which is implementedby, for example, a liquid crystal display, an organic EL display, or thelike, displays characters, images, and other items of information on thedisplay screen. The display of characters, images, and other items ofinformation is controlled by a device control unit 112 of a main controlunit 11 described below.

The operation unit function of the touchscreen 12 is implemented by, forexample, an operation surface which is overlaid on top of the displayscreen and detects a position touched by the user. The operation surfaceis a curved surface extending along the outer circumferential directionof the user's arm. The operation surface may include a plurality ofportions having different curvatures.

It is desirable that the touchscreen 12 should have a large area so thatthe information processing apparatus 10 which is a wristwatch terminalcan provide various functions. However, if a large touchscreen whichprotrudes upward or downward from the user's arm is provided, thewearability and operability of the wristwatch terminal deteriorate.Therefore, as shown in FIG. 2, the touchscreen 12 has a curved surfacehaving a narrow width for fitting the arm 200.

As shown in FIG. 2, the user performs a touch operation on the operationsurface overlaid on top of the display screen of the touchscreen 12 ofthe information processing apparatus 10 worn on the arm 200 whileviewing the display screen.

As shown in FIGS. 1 and 2, the speakers 15 a and 15 b, which have thefunction of outputting sounds, are implemented as a front speaker and aback speaker, respectively, which are provided in the outercircumferential surface of the information processing apparatus 10. Thefront speaker is located near the touchscreen 12, and the back speakeris located half the circumference away from the front speaker.

As shown in FIGS. 1 and 2, the mics 16 a and 16 b, which have thefunction of collecting sounds, are implemented as a front mic and a backmic, respectively, which are provided in the outer circumferentialsurface of the information processing apparatus 10. The front mic islocated near the touchscreen 12, and the back mic is located half thecircumference away from the front mic.

Note that the numbers and positions of the speakers 15 a and 15 b andthe mics 16 a and 16 b shown in FIGS. 1 and 2 are merely illustrative,and this embodiment is not limited to this. Alternatively, for example,an array speaker and an array mic may be provided along an end portionof the wristband.

(Background)

Here, as shown in FIG. 2, when an input operation is performed on thetouchscreen 12 of the information processing apparatus 10 which is wornon one arm 200, the other arm is used for the input operation, andtherefore, it is necessary to use both arms. Therefore, if gestures canbe input by detecting motions of an arm, input operations can beperformed by moving only one arm 200 on which the information processingapparatus 10 is worn, and therefore, the usability of the informationprocessing apparatus 10 is improved.

When the information processing apparatus 10 is used to perform viewingof the display screen, calling, or shooting, the state of the arm 200 onwhich the information processing apparatus 10 is worn differs betweenthese actions. If intuitive input operations can be performed accordingto the difference in the state, the usability of the informationprocessing apparatus 10 is further improved.

The detection value of a motion sensor or the like used for recognizingsuch a state (motion) of the arm 200 differs depending on whether theinformation processing apparatus 10 is worn on the user's right arm orleft arm.

With this in mind, in this embodiment, proposed is the informationprocessing apparatus 10 which can recognize the state of the arm on thebasis of determination of whether the information processing apparatus10 is worn on the left arm or the right arm, and control each device inthe information processing apparatus according to the state of the arm.

In the foregoing, an overview of the information processing apparatus 10according to an embodiment of the present disclosure has been described.Next, a basic configuration of the information processing apparatus 10according to the present disclosure will be described with reference toFIG. 3.

2. Basic Configuration

FIG. 3 is a block diagram showing a basic configuration of theinformation processing apparatus 10 according to this embodiment. Asshown in FIG. 10, the information processing apparatus 10 has a maincontrol unit 11, a touch panel display 12, a motion sensor 13, a storageunit 14, a speaker 15, a mic 16, and a communication unit 17.

(Main Control Unit)

The main control unit 11 includes, for example, a microcomputerincluding a central processing unit (CPU), a read only memory (ROM), arandom access memory (RAM), a non-volatile memory, and an interfaceunit. The main control unit 11 controls the components of theinformation processing apparatus 10.

The main control unit 11 according to this embodiment also functions asa determination unit 110, a recognition unit 111, and a device controlunit 112. The determination unit 110 determines whether the informationprocessing apparatus 10 is worn on the user's right arm or left arm.Specifically, for example, the determination unit 110 can determineswhether the information processing apparatus is worn on the user's rightarm or left arm, on the basis of a detection value output from themotion sensor 13.

Here, the determination of whether the information processing apparatus10 is worn on the user's right arm or left arm, which is performed bythe determination unit 110, will be described with reference to FIG. 4.FIG. 4 is a diagram for describing the determination of whether theinformation processing apparatus 10 is worn on the user's right arm orleft arm, which is performed using an acceleration sensor. Here, anacceleration sensor is used as an example of the motion sensor 13provided in the information processing apparatus 10. For example, asshown in FIG. 4, the information processing apparatus 10 is worn on awrist in a position that allows the wearer to properly view the displayscreen, and the orientation of the acceleration sensor is set so that anacceleration in the X-axis direction is negative when the informationprocessing apparatus 10 is worn on the right arm, and positive when theinformation processing apparatus 10 is worn on the left arm, where thearm on which the information processing apparatus 10 is worn pointsdownward.

When the orientation of the acceleration sensor is known, thedetermination unit 110 can determine that the information processingapparatus 10 is worn on the right arm if the acceleration in the X-axisdirection is negative, and that the information processing apparatus 10is worn on the left arm if the acceleration in the X-axis direction ispositive, on the basis of the detection value of the acceleration sensorthat is obtained when the arm points downward.

The determination unit 110 outputs the determination result to therecognition unit 111. Note that the determination unit 110 can determinewhether the information processing apparatus 10 is worn on the left armor the right arm, on the basis of mechanical learning or the user'sinput, in addition to the automatic determination of whether theinformation processing apparatus 10 is worn on the left arm or the rightarm, on the basis of the detection value from the motion sensor 13. Forexample, when the orientation of the acceleration sensor is not known,the determination unit 110 extracts patterns by sampling detectionvalues that are continuously output from the motion sensor 13 (e.g., anacceleration sensor), and performs matching between the extractedpatterns and training data (patterns of motions (states) of the rightarm and the left arm) for machine learning, and determines whether theinformation processing apparatus 10 is worn on the left arm or the rightarm. Alternatively, when the user inputs, from the touchscreen 12,information indicating whether the information processing apparatus 10is worn on the left arm or the right arm, or when the user inputs suchinformation using their voice through the mic 16, the determination unit110 determines whether the information processing apparatus 10 is wornon the left arm or the right arm, on the basis of the input information.

The recognition unit 11 has the function of recognizing the state of thearm 200 worn on the information processing apparatus 10. Specifically,for example, the recognition unit 111 recognizes the state (motion) ofthe arm on the basis of a detection value output from the motion sensor13. The recognition unit 111 can also switch settings of a parameterwhich is used in recognition of the state of the arm, according to theresult of the determination performed by the determination unit 110, andthereby more correctly recognize the state of the arm even the motion iscomplicated. For example, the sign of a detection value output from theacceleration sensor which is an example of the motion sensor 13 changesdepending on whether the information processing apparatus 10 is worn onthe left arm or the right arm. Therefore, if the sign of the parameteris switched according to whether the information processing apparatus 10is worn on the left arm or the right arm, the recognition unit 111 canmore correctly recognize the state of the arm. Note that variations ofthe state of the arm recognized by the recognition unit 111 will bespecifically described in “3. Device Control Examples according toState” below. The recognition unit 111 also sends the recognition resultto the device control unit 112.

The device control unit 112 has the function of performing predeterminedcontrol on various devices provided in the information processingapparatus 10 according to the state of the arm recognized by therecognition unit 111. For example, the device control unit 112 switcheson/off, changes settings, and the like, with respect to various devicessuch as the display unit and operation unit of the touchscreen 12, themotion sensor 13, the speaker 15, and the mic 16. As described in “3.Device Control Examples according to State” below, the purpose of use(user context) of the information processing apparatus 10 which is awristwatch terminal having a number of functions is estimated on thebasis of the state of the arm recognized by the basis of the recognitionunit 111. Therefore, the device control unit 112 performs device controlaccording to the estimated purpose of use. Specifically, for example,the device control unit 112 switches on a device required for theestimated purpose of use, changes the setting of a performance rate ofan output/input device when necessary, or switches off a device notrequired.

As a result, the user can perform device control according to thepurpose of use only by moving the arm 200 without bothering to performan input operation on the touchscreen 12. Specifically, by causing theinformation processing apparatus 10 to recognize the motion of the armwhich varies depending on the purpose of use such as viewing of thedisplay screen, calling, or shooting, and recognize the motion as agesture command, the switching on and off of various devices can beautomatically controlled only by a more natural motion of the user.

(Touch Panel Display)

As described above, the touch panel display 12 functions as a displayunit and an operation unit (e.g., a touch sensor).

(Motion Sensor)

The motion sensor 13, which is a sensor for detecting the state (motion)of the arm 200 on which the information processing apparatus 10 is worn,is implemented by a device for detecting a spatial motion or angle, suchas an acceleration sensor, a gyroscopic sensor, a geomagnetic sensor, orthe like. Alternatively, the motion sensor 13 may include a combinationof different sensors.

Note that when a method of determining a physical state of a deviceusing a short-range sensor included in the device itself, which methodis, for example, employed in smartphones, is applied to a wristwatchterminal, it is necessary to hold the information processing apparatus10 as close to an ear as possible so that the short-range sensor canrecognize a state of the information processing apparatus 10 held closeto the ear, such as state 3 which will be described below with referenceto FIG. 5. However, such a motion is unnatural, which causes physicalload on the user. With this in mind, in this embodiment, a motion sensoris used to recognize the state of the arm so that the state can berecognized while a natural motion is performed without putting the bodyin an unnatural position.

(Communication Unit)

The communication unit 17 has the function of connecting to an externalapparatus and exchanging data with the external apparatus. For example,the communication unit 17 may connect to a smartphone carried by theuser and exchange data with the smartphone, or may connect to apredetermined server through a network and exchange data with theserver. Alternatively, the communication unit 17 may communicate audiosignals through a mobile telephone network or the Internet network.

(Storage Unit)

The storage unit 14 stores a program or the like for execution ofvarious processes performed by the main control unit 11. For example,the storage unit 14 stores data related to predetermined control ofvarious devices which is performed by the device control unit 112according to the recognized state.

(Speaker)

The speaker 15 has the function of outputting sounds (audio signal). Forexample, the speaker 15 sounds the alarm to the user, or outputsreceived voice during a conversation.

(Mic)

The mic 16 has the function of collecting sounds (audio signal). Forexample, the mic 16 receives the user's voice input, or collects theuser's voice uttered during a conversation.

In the foregoing, a configuration of the information processingapparatus 10 according to this embodiment has been described in detail.Next, device control examples according to a state of the informationprocessing apparatus 10 will be described using a plurality of specificexamples.

3. Device Control Examples According to State 3-1. Device ControlExamples in State 1, State 2, and State 3

Firstly, device control examples in states 1 to 3 will be described withreference to FIGS. 5 to 8. FIG. 5 is a diagram for describing states 1to 3. State 1 shown on the left side of FIG. 5 illustrates a state inwhich an arm (hand) on which the information processing apparatus 10 isworn is lowered. State 2 shown on the middle of FIG. 5 illustrates astate in which an arm (hand) is positioned in front of a lower portionof the body (a state in which the arm is raised in order to view thedisplay screen of the information processing apparatus 10). State 3illustrates a state in which the arm (hand) is held close to an ear (astate in which calling is being performed with the back speaker 15 b andthe rear mic 16 b (the anterior side of a wrist) being held close to theface).

The recognition unit 111 of the information processing apparatus 10 canrecognize states 1 to 3 on the basis of a detection value from themotion sensor 13 provided in the information processing apparatus 10.

FIG. 6 is a state transition diagram showing transitions between states1 to 3. As shown in FIG. 6, a transition can occur from state 1 (D1) inwhich the arm is lowered to state 2 (D2) in which the arm is raised, andvice versa. A transition can occur from state 1 (D1) in which the arm islowered to state 3 (D3) in which the arm is held close to an ear, andvice versa. A transition can occur from state 2 (D2) in which the arm israised to state 3 (D3) in which the arm is held close to an ear, andvice versa.

The recognition unit 111 of the information processing apparatus 10recognizes the current state on the basis of a detection value from themotion sensor 13, and outputs the recognition result to the devicecontrol unit 112. A transition can occur between states 1 to 3 as shownin FIG. 6, and therefore, the recognition unit 111 can recognize thecurrent state in real time on the basis of detection values continuouslyoutput from the motion sensor 13.

Thereafter, the device control unit 112 performs predetermined controlon each device according to the recognized state. For each state, thedevice control unit 112 can turn off the function of a device which isnot to be used in the state to reduce power consumption, and turn on thefunction of a device which is to be used in the state without botheringto perform an operation to turn on (e.g., an explicit operation on thetouchscreen 12), so that the function of a required device can beexhibited when necessary.

Here, each of the device control examples according to the state will bedescribed with reference to FIG. 7. FIG. 7 is a diagram showing a listof control of devices in states 1 to 3. Here, examples of the devicesinclude a “touch sensor” corresponding to an operation unit included inthe touchscreen 12, an “acceleration sensor” and a “gyroscopic sensor”implemented as the motion sensor 13, and a “display” corresponding tothe display unit included in the touchscreen 12. Examples of the devicesalso include a “back speaker” corresponding to the speaker 15 b, a“front speaker” corresponding to the speaker 15 a, and “mics”corresponding to the mics 16 a and 16 b.

(3-1-1. Device Control in State 1)

As shown in FIG. 7, for example, it is assumed that a touch operation isnot performed in state 1 in which the arm is lowered, and therefore, thetouch sensor is controlled to be off. When the motion sensor 13 includesa plurality of sensors (e.g., an acceleration sensor and a gyroscopicsensor), one of the sensors is on while the other sensor is off. If thesensor which is on is controlled so that the sampling rate is low, powerconsumption can be reduced. The sampling rate may be as low as atransition from state 1 to state 2 or state 3 can be detected. Although,in the example shown in FIG. 7, the gyroscopic sensor is off while theacceleration sensor is on, because the gyroscopic sensor consumes morepower, this embodiment is not limited to this. The opposite of the abovecontrol is possible.

In state 1, the display is controlled to be off because it is assumedthat the display is not viewed. Alternatively, the display is controlledto simply display only a clock or the like. In addition, it is assumedthat the user is not viewing the display, and therefore, the refreshrate (screen updating rate) is controlled to be low. Thus, the powerconsumption of the display is reduced when the display is not used.

State 1 is also considered as a state in which an incoming call or mailis waited for. Therefore, in state 1, when a call or a mail is received,it is necessary to notify the user of the reception of a call or a mail,and therefore, at least one of the front speaker 15 a and the backspeaker 15 b is controlled to be on. In addition, in order to notify theuser, the output is controlled to be high (loud sound). Note that theuser may be notified of a call or a mail by vibrations. In this case,all the speakers are controlled to be off, and a vibration unit (notshown) is control to be on.

In state 1, it is also not assumed that the mic is used, and therefore,the mic is controlled to be off.

(3-1-2. Device Control in State 2)

Next, when there is an incoming call or mail in state 1, the user raisesand holds the arm in front of the user's body while causing the displayscreen of the information processing apparatus 10 faces the user so thatthe user can view the display screen, which is state 2. At this time,the recognition unit 111 recognizes a transition from state 1 to state2, and outputs the recognition result to the device control unit 112.The device control unit 112 performs predetermined control on eachdevice in response to the transition to state 2.

Specifically, as shown in FIG. 7, in state 2 in which the arm is raisedand held in front of the body, it is assumed that a touch operation isperformed, and therefore, the touch sensor is controlled to be on. Themotion sensor 13 is controlled as in state 1. When a plurality ofsensors are included, one of the sensors is on while the other sensor isoff. The sensor which is on is controlled so that the sampling rate islow, whereby power consumption is reduced. The sampling rate may be aslow as a transition from state 1 to state 2 or state 3 can be detected.

In state 2, it is assumed that the display is viewed, and therefore, thedisplay is controlled to be on. It is also assumed that the user isviewing the display, and therefore, the refresh rate (screen updatingrate) is controlled to be high. The display shows, for example, the nameof a mail sender, the title of a mail, or the name of a caller, thenumber of a call, or the like.

In state 2, it is also assumed that a conversation is continued after atransition from the state 3, and therefore, the front speaker 15 a iscontrolled to be on, and the output is controlled to be high (loudsound). As a result, even when the information processing apparatus 10is away from the ear of state 3, the user can continue a conversation.

When a conversation is continued, it is assumed that the mic is used.Therefore, in state 2, the mic is controlled to be on. Alternatively, itis also assumed that the user who has confirmed a mail sender or acaller on the display may answer using an audio input. Therefore, instate 2, the mic is controlled to be on. In this case, the mic is awayfrom the user's face, and therefore, the sensitivity of the mic iscontrolled to be high.

(3-1-3. Device Control in State 3)

Next, when, in state 2, the user confirms a caller and then answers thecall, the user raises the arm and moves the anterior side of the wristto near the face while still holding the information processingapparatus 10, and holds the hand close to an ear, i.e., a transitionoccurs from state 2 to state 3 (see FIG. 5). At this time, therecognition unit 111 recognizes the transition from state 2 to state 3,and outputs the recognition result to the device control unit 112. Thedevice control unit 112 performs predetermined control on each device inresponse to the transition to state 3.

Specifically, as shown in FIG. 7, in state 3 in which the hand is heldclose to an ear, it is assumed that a touch operation is not performed,and therefore, the touch sensor is controlled to be off as in state 1.The motion sensor 13 is also controlled as in state 1. When the motionsensor 13 includes a plurality of sensors, one of the sensors is onwhile the other sensor is off. The sensor which is on is controlled sothat the sampling rate is low, whereby power consumption is reduced. Thesampling rate may be as low as a transition from state 3 to state 1 orstate 2 can be detected.

Also, in state 3, it is assumed that the display is not viewed, andtherefore, the display is controlled to be off as in state 1.Alternatively, the display is controlled to simply display only a clockor the like. In addition, it is assumed that the user is not viewing thedisplay, and therefore, the refresh rate (screen updating rate) iscontrolled to be low.

Also, a transition from state 2 to state 3 corresponds to a gestureanswering a call, and therefore, the back speaker 15 b, which is locatedon the anterior side of a wrist facing the face, is controlled to be on,and is control to reduce the output (low sound) because the back speaker15 is located close to an ear. Also, the device control unit 112performs control so that received voice is output from the back speaker15 b. As a result, the transition from state 2 to state 3, whichcorresponds to a motion for having a conversation, is simultaneouslyrecognized as a gesture command for answering a call. Therefore, theuser can start a conversation without performing a touch operation orthe like.

Also, in state 3 in which the user answers a call, the mic is controlledto be on, and is controlled to be less sensitive because the mic isclose in distance to the face. The device control unit 112 performscontrol so that the user's voice collected by the mic is transmitted toan information processing terminal of the other side of the call throughthe communication unit 17.

In the foregoing, device controls in states 1 to 3 have been described.Note that after the user is notified of an incoming call and then atransition to state 2 occurs, the user may check the display, and thenlower the arm, so that a transition to state 1 occurs, which isrecognized as a gesture command indicating that the user does not answerthe call. In this case, the device control unit 112 sends, for example,a message that “I can't answer your call right now” to an information 16processing terminal of the other side of the call, and endscommunication.

Also, a transition to state 3 may occur, in which the user answers acall, and thereafter, a transition to state 2 may occur during aconversation. In this case, it is assumed that the user desires to checkthe display while continuing a conversation. Therefore, the devicecontrol unit 112 performs control so that the output of the speaker isincreased, and the display and the touch sensor are controlled to be on.Also, the device control unit 112 increases the sensitivity of the micso that the mic can collect the user's voice irrespective of theinformation processing apparatus 10 being away from the face.

When the state of the arm returns to state 3 in which the hand is heldclose to an ear after the user has finished checking information on thedisplay, the device control unit 112 performs control so that thedisplay is controlled to be off again and the output of the speaker isdecreased.

Thereafter, when a transition occurs from state 3 to state 1, the devicecontrol unit 112 recognizes such a transition as a gesture command forending the call, and performs control so that the call is ended.

Thus, according to this embodiment, when the user only performs anaction corresponding to a user context, the control of each device isoptimized so that it is not necessary for the user to perform otheroperations (e.g., tapping the screen, operating a hardware key, etc.),resulting in an improvement in operability and usability. Examples of anaction corresponding to a user context include the action of viewing thetouchscreen 12 in order to check an incoming call/mail if notified ofany, the action of holding the information processing apparatus 10 closeto an ear when it is necessary to have a conversation.

Note that the device control shown in FIG. 7 is merely illustrative, andthis embodiment is not limited to this. For example, only a singlemotion sensor may be provided, and only a single speaker may beprovided. In this case, device control corresponding to each state isperformed as shown in FIG. 8, for example. FIG. 8 is a diagram showing alist of other control of devices in states 1 to 3.

In FIG. 8, when only a single motion sensor is used, the motion sensoris controlled to be on, and the sampling rate is set to low, in allstates 1 to 3.

Also, when only a single speaker is used, the speaker is controlled tobe on, and the output is set to high, in state 1. In state 2, thespeaker is controlled to be off. In state 3, the speaker is controlledto be on, and the output is set to low. When only a single speaker isused, the position where the speaker is placed is not particularlylimited.

3-2. Device Control Examples in State 1, State 2, and State 4

Next, other gesture inputs in state 2 will be described with referenceto FIGS. 9 to 12. FIG. 9 is a diagram for describing state 1, state 2,and state 4. State 1 shown on the left side of FIG. 9 and state 2 shownin the middle of FIG. 9 are similar to those described with reference toFIG. 5.

State 4 shown on the right side of FIG. 9 illustrates a state in whichthe arm (hand) is rotated while the arm is held in front of a lowerportion of the body (a state in which the arm is raised in order to viewthe display screen of the information processing apparatus 10).

The recognition unit 11 of the information processing apparatus 10 canrecognize state 1, state 2, and state 4 on the basis of detection valuesfrom the motion sensor 13 provided in the information processingapparatus 10.

FIG. 10 is a state transition diagram showing transitions between state1, state 2, and state 4. As shown in FIG. 10, a transition can occurfrom state 1 (D1) in which the arm is lowered to state 2 (D2) in whichthe arm is raised in front of the body, and vice versa. A transition canoccur from state 2 (D2) in which the arm is raised in front of the bodyto state 4 (D4) in which the arm is rotated in front of the body, andvice versa.

State 4 results from a transition from state 2. Therefore, it is assumedthat state 4 corresponds to an action which is performed during theoccurrence of a user context in which the user desires to view the nextscreen or the previous screen while the user is viewing the displayscreen of the information processing apparatus 10 in state 2. With thisin mind, in this embodiment, control is performed so that screentransition of the touchscreen 12 occurs according to a state of rotationof the arm (rotation toward or away from the body).

FIG. 11 is a diagram showing a list of control of devices in state 1,state 2, and state 4. The control of each device in state 1 has beendescribed above with reference to FIG. 7 and therefore will not be heredescribed.

Of the control of devices in state 2, the control of a motion sensor isdifferent from that shown in FIG. 7, i.e., the sampling data is set tohigh. In this embodiment, a transition may occur from state 2 to state4, and it is necessary to correctly detect a complicated motion such asa rotation of the arm, and therefore, the detection level of the motionsensor is increased when a transition to state 2 has occurred. Notethat, in this case, while the sampling rate of the acceleration sensorremains low, the gyroscopic sensor may be controlled to be on. Also, thecontrol of other devices in state 2 is similar to that of the exampleshown in FIG. 7.

In state 4, as shown in FIG. 11, the action of rotating the arm(rotation toward or away from the body) is accepted as the action of“returning” or “proceeding,” and the device control unit 112 controlsthe display so that the display returns to the immediately previousscreen or proceeds to the next screen. Note that control for state 2 ismaintained for the devices other than the display (specifically, thetouch sensor, the motion sensor, the speaker, and the mic).

Thus, according to this embodiment, the user can change display screensonly by rotating their arm on which the information processing apparatus10 is worn, without performing an input operation on the touchscreen.

(Supplement 1)

Note that the device control shown in FIG. 11 is merely illustrative,and this embodiment is not limited to this. For example, only a singlemotion sensor may be provided, and only a single speaker may beprovided. In this case, the device control is performed according tostates as shown in FIG. 12, for example. FIG. 12 is a diagram showing alist of other control of devices in state 1, state 2, and state 4.

As shown in FIG. 12, in state 4, the action of rotating the arm(rotation toward or away from the body) is accepted as the action of“returning” or “proceeding.” and the device control unit 112 controlsthe display so that the display returns to the immediately previousscreen or proceeds to the next screen, as in the case shown in FIG. 11.Note that control for state 2 is maintained for the devices other thanthe display (specifically, the touch sensor, the motion sensor, thespeaker, and the mic).

(Supplement 2)

Also, a user context which varies depending on the rotation of the armmay be recognized. This will now be described with reference to FIG. 13.

FIG. 13 is a diagram for describing examples of the rotation of the arm.As shown in the top of FIG. 13, the action of largely moving the armtoward or away from the body corresponds to the rotation of the arm instate 4 shown on the right side of FIG. 9, which causes the devicecontrol unit 112 to change screens.

Meanwhile, as shown in the bottom of FIG. 13, the action of twisting thearm (wrist) may be recognized by the recognition unit 111. In this case,the device control unit 112 can perform volume control by controllingthe output of the speaker according to the direction or degree in or towhich the arm is twisted, for example. For example, when a transitionoccurs from state 3 to state 2, the user checks the display whilecontinuing a conversation, and therefore, the output of the speaker iscontrolled to be high. In this case, it may be desirable to adjust theoutput of the speaker (the amount of sound) according to the time or theplace.

3-3. Device Control Example During Wearing on Right Arm (State 5)

Next, a device control example according to whether the informationprocessing apparatus 10 is worn on the left arm or the right arm will bedescribed with reference to FIGS. 14 to 20. FIG. 14 is a diagram fordescribing state 1, state 2, and state 5. State 1 shown on the left sideof FIG. 14, and state 2 shown in the middle of FIG. 14, are similar tothose described with reference to FIG. 5, in both of which theinformation processing apparatus 10 is worn on the left arm.

Meanwhile, state 5 shown on the right side of FIG. 14 is a state inwhich the information processing apparatus 10 is worn on the right arm,and the right arm is held in front of a lower portion of the body (astate in which the right arm is raised in order to view the displayscreen of the information processing apparatus 10).

The decision on whether the information processing apparatus 10 is wornon the left arm or the right arm differs from person to person. However,for example, if operations on the touchscreen 12 are taken intoconsideration, it is assumed that the information processing apparatus10 is worn on the arm of the non-dominant hand, and the dominant hand isused to operate the touchscreen 12.

In this case, for example, when a right-handed person wears theinformation processing apparatus 10 on their left arm, and operates thetouchscreen 12 using the right hand in state 2 shown in FIG. 14,conventional display control in which the arm on which the informationprocessing apparatus 10 is worn is not taken into consideration raisesthe following problems.

FIG. 15 is a diagram showing a display screen example of an informationprocessing apparatus 100 according to a comparative example. As shown inFIG. 15, when the information processing apparatus 100 which is awristwatch terminal is worn on the left arm and is operated using theright arm, then if a command system is displayed on the left side of thescreen, the screen is hidden by the right hand as it is being used foroperation, because the area of the touchscreen is small (a curvedsurface having a narrow width for fitting an arm).

With this in mind, in this embodiment, the display is allowed to becontrolled in different ways according to whether the informationprocessing apparatus 10 is worn on the left arm or the right arm (state2/state 5). This will now be specifically described with reference toFIGS. 16 and 17.

FIG. 16 is a diagram showing a display screen example where theinformation processing apparatus 10 according to this embodiment is wornon the left arm. As shown in FIG. 16, when it is determined that theinformation processing apparatus 10 which is a wristwatch terminal isworn on the left arm (state 2 shown in FIG. 14), then if the informationprocessing apparatus 10 is controlled so that a command system isdisplayed on the right side of the screen (the touchscreen 12), thesituation that the screen is hidden by the user's right hand as it isbeing used 6 to touch the command system, can be avoided.

FIG. 17 is a diagram showing a display screen example where theinformation processing apparatus 10 according to this embodiment is wornon the right arm. As shown in FIG. 17, when it is determined that theinformation processing apparatus 10 which is a wristwatch terminal isworn on the right arm (state 5 shown in FIG. 14), then if theinformation processing apparatus 10 is controlled so that a commandsystem is displayed on the left side of the screen (the touchscreen 12),the situation that the screen is hidden by the user's left hand as it isbeing used to touch the command system, can be avoided.

As described above, in this embodiment, the display is switchedaccording to whether the information processing apparatus 10 is worn onthe left arm or the right arm, whereby the usability of the informationprocessing apparatus 10 can be further improved. Note that the devicecontrol which is switched in state 2, according to whether theinformation processing apparatus 10 is worn on the left arm or the rightarm, is not limited to the above display control. For example, thecontrol of the touch sensor may be switched according to whether theinformation processing apparatus 10 is worn on the left arm or the rightarm. This will now be specifically described with reference to FIGS. 18to 20.

(Right and Left Switching Control of Touch Sensor)

FIG. 18 is a diagram for describing a detectable region of the touchsensor. As shown in FIG. 18, the information processing apparatus 10according to this embodiment may be configured to have an operableregion 20 of the touch sensor outside the region of the touch paneldisplay 12 on which a screen, such as a map or the like, is displayed.In this case, the user can perform a zooming operation on a screen, suchas a map or the like, using a region outside the screen region.Specifically, the main control unit 11 of the information processingapparatus 10 provides a touch detection region to the left and right ofthe screen region, and assigns a screen zooming operation to thisregion.

Here, the information processing apparatus 10 which is a wristwatchterminal has a small screen region, taking into consideration theportability of the information processing apparatus 10 worn on an arm.Therefore, the small screen region is not suitable for operations usinga plurality of fingers, such as pinch and depinch. A method forperforming a zooming operation using command buttons as shown in FIG. 16is suitable for the small screen region. However, a problem arises thata portion of the display screen is hidden by the command buttons.Therefore, if a touch detection region is provided to the left and rightof the screen region, an operation method suitable for a zoomingoperation can be provided. For example, zooming in/out can be performedby dragging vertically outside the screen region.

At this time, it is necessary to avoid the problem that a hand beingused for operation overlaps the screen, as in the case of the aboveoperation described using the comparative example shown in FIG. 15. Withthis in mind, in this embodiment, control is performed to determinewhich of the left and right touch detection regions outside the screenregion is assigned a zooming operation, on the basis of whether theinformation processing apparatus 10 is worn on the left arm or the rightarm. This will now be specifically described with reference to FIGS. 19and 20.

FIG. 19 is a diagram for describing the assignment of the zoom operationregion when the information processing apparatus 10 according to thisembodiment is worn on the left arm. As shown in FIG. 19, when it isdetermined that the information processing apparatus 10 which is awristwatch terminal is worn on the left arm (state 2 shown in FIG. 14),the touch sensor is controlled so that a right off-screen region 22 isassigned a zooming operation. As a result, the situation that the screenis hidden by the user's right hand as it is being used to touch the leftoff-screen region, can be avoided.

FIG. 20 is a diagram showing a display screen example where theinformation processing apparatus 10 according to this embodiment is wornon the right arm. As shown in FIG. 20, when it is determined that theinformation processing apparatus 10 which is a wristwatch terminal isworn on the right arm (state 5 shown in FIG. 14), the touch sensor iscontrolled so that a left off-screen region 24 is assigned a zoomingoperation. As a result, the situation that the screen is hidden by theuser's left hand as it is being used to touch the right off-screenregion, can be avoided.

As described above, in this embodiment, the specific operation detectionregion is switched according to whether the information processingapparatus 10 is worn on the left arm or the right arm, whereby theusability of the information processing apparatus 10 can be furtherimproved. Note that, in the information processing apparatus 10according to this embodiment, one of the off-screen regions which is notassigned a zooming operation may be assigned a predetermined operationwhich is relatively less frequently used (less frequently than thezooming operation).

For example, the device control unit 112 of the information processingapparatus 10 may perform control so that one of the off-screen regionswhich is not assigned a zooming operation is assigned a screen rotatingoperation. For example, the screen can be rotatedclockwise/anticlockwise by dragging vertically in the off-screen region.Thus, an off-screen region on one side in which an operation can beperformed without the screen being hidden may be assigned the task ofdetecting an operation which is relatively frequently performed, whilean off-screen region on the opposite side may be assigned the task ofdetecting an operation which is relatively less frequently performed,whereby a comfortable operation can be provided.

3-4. Device Control Example in State 6

Next, assuming that the information processing apparatus 10 has a camerafunction, a device control example in state 6 where a camera is held ina shooting position will be described with reference to FIGS. 21 to 24.The configuration of the information processing apparatus 10 accordingto this embodiment is not limited to the examples shown in FIGS. 1 to 3.For example, it is assumed that the information processing apparatus 10according to this embodiment further includes an imaging unit(hereinafter referred to as a camera).

The camera has a lens system including an imaging lens, a diaphragm, azooming lens, a focusing lens, and the like, a drive system for causingthe lens system to perform a focusing operation or a zooming operation,a solid-state imaging element array for performing photoelectricconversion on imaging light obtained by the lens system to generate animaging signal. The solid-state imaging element array may be implementedby, for example, a charge coupled device (CCD) sensor 16 array or acomplementary metal oxide semiconductor (CMOS) sensor array. The cameraaccording to this embodiment can capture a still image and a movingimage.

Although the position where the imaging lens is provided is notparticularly illustrated, the imaging lens is provided on, for example,an outer circumferential surface of the information processing apparatus10 between the speaker 15 a and the mic 16 a, and as shown in FIG. 2,when the information processing apparatus 10 is worn on the arm 200, thedirection of shooting may be the direction in which the little finger(the outer side of the arm) faces. In this case, when the camera isused, the user raises and holds the arm on which the informationprocessing apparatus 10 is worn, in front of the body, and aims theouter side (little finger) of the arm at a subject (aims the imaginglens at a subject), as shown in state 6 of FIG. 21.

The recognition unit 111 of the information processing apparatus 10 canrecognize state 6 on the basis of a detection value from the motionsensor 13 provided in the information processing apparatus 10.

FIG. 22 is a state transition diagram showing transitions between state1, state 2, and state 6. As shown in FIG. 22, a transition can occurfrom state 1 (D1) in which the arm is lowered to state 2 (D2) in whichthe arm is raised, and vice versa. A transition can occur from state 1(D1) in which the arm is lowered to state 6 (D6) in which the camera isheld in a shooting position, and vice versa. A transition can occur fromstate 2 (D2) in which the arm is raised to state 6 (D6) in which thecamera is held in a shooting position, and vice versa.

The recognition unit 111 of the information processing apparatus 10recognizes the current state on the basis of a detection value from themotion sensor 13, and outputs the recognition result to the devicecontrol unit 112. Also, transitions occur between state 1, state 2, andstate 6 as shown in FIG. 22. Therefore, the recognition unit 11 canrecognize the current state in real time on the basis of detectionvalues continuously output from the motion sensor 13.

Thereafter, the device control unit 112 performs predetermined controlon each device according to the recognized state. For each state, thedevice control unit 112 can turn off the function of a device which isnot to be used in the state to reduce power consumption, and turn on thefunction of a device which is to be used in the state without botheringto perform an operation to turn on (e.g., an explicit operation on thetouchscreen 12), so that the function of a required device can beexhibited when necessary.

FIG. 23 is a diagram showing a list of control of devices in state 1,state 2, and state 6. As shown in FIG. 23, the camera is newly added todevices to be controlled.

As shown in FIG. 23, in state 1 in which the arm is lowered, the camerais not assumed to be used, and is controlled to be off:

Also, in state 2 in which the arm is held in a horizontal position infront of the body, the display is viewed, and the camera is not assumedto be used, and is controlled to be off. Also, as to the motion sensor,the gyroscopic sensor is controlled to be on. In this embodiment, atransition may occur from state 2 to state 6, and it is necessary tocorrectly detect a complicated motion of holding the camera in ashooting position. Therefore, when a transition to state 2 has occurred,the detection level of the motion sensor is increased. Note that, inthis case, the sampling rate of the acceleration sensor may be set tohigh while the gyroscopic sensor is off.

In state 3 in which the camera is held in a shooting position, thecamera is assumed to be used, and is controlled to be on (the camera isactivated). Also, during shooting of a moving image, the mic iscontrolled to be on, and the sensitivity thereof is set to high.Meanwhile, during shooting of a still image, it is not necessary tocollect sounds using the mic, and the mic is controlled to be off. Notethat the camera may be switched between still image shooting and movingimage shooting, in response to the recognition of an additional actionof swinging the arm in state 6.

Also, in state 3, the touch sensor, the display, and the speaker (theback speaker and the front speaker) are not assumed to be used, and arecontrolled to be off.

(Supplements)

The device control shown in FIG. 23 is merely illustrative, and thisembodiment is not limited to this. For example, only a single motionsensor may be provided, and only a single speaker may be provided. Inthis case, the device control is performed according to the states asshown in FIG. 24, for example. FIG. 24 is a diagram showing a list ofother control of devices in state 1, state 2, and state 6.

In state 6 shown in FIG. 24, as in the case shown in FIG. 23, the camerais assumed to be used, and is controlled to be on (the camera isactivated). Also, the mic is similarly controlled to be on duringshooting of a moving image, and the sensitivity thereof is set to high.Meanwhile, during shooting of a still image, it is not necessary tocollect sounds using the mic, and the mic is controlled to be off.

Also, because only a single motion sensor is used, the sampling rate isset to high in state 2 in order to correctly detect a more complicatedmotion (a transition to state 6 in which the camera is held in ashooting position).

5. Conclusion

As described above, the state of the arm is recognized on the basis ofthe determination of whether the information processing apparatus 10according to an embodiment of the present disclosure which is awristwatch terminal is worn on the left arm or the right arm, and thedevices in the information processing apparatus 10 can be controlledaccording to the recognized state of the arm.

Also, in wristwatch terminals, only a small-size battery is mounted, andtherefore, it is necessary to invariably reduce the power consumption.Under these circumstances, the information processing apparatus 10according to this embodiment is controlled so that an unnecessary deviceis turned off according to a user context corresponding to therecognized state of the arm, whereby the power consumption can bereduced.

The preferred embodiment(s) of the present disclosure has/have beendescribed above with reference to the accompanying drawings, whilst thepresent disclosure is not limited to the above examples. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.

For example, a computer program that allows hardware including CPU, ROM,and RAM incorporated in the above-described information processingapparatus 10 to perform functions of the information processingapparatus 10 may also be created. A storage medium on which the computerprogram is stored may be provided.

Also, a transition may occur between any combination of states 1 to 6.Also, the relationship between the states and the device control ismerely illustrative. The device control unit 112 according to thisembodiment may perform control so that a user context associated withthe recognized state (viewing the display, calling, mailing, listeningto music, etc.) is satisfied.

Also, the device control according to the action of rotating the arm asshown in state 4 of FIG. 9 or the action of twisting the arm as shown inthe bottom of FIG. 13, are not limited to the above screen transition(returning to the immediately previous screen/proceeding to the nextscreen) or volume control. For example, the device control may includemoving to a home screen, calling a notification screen, activating aspecific application (camera, telephone, map (navigation)), displaying acommunication history (telephone, mail, SNS), and the like.

Also, the determination unit 110 can determine the orientation (i.e.,upward or downward) of the touchscreen 12 (screen) of the informationprocessing apparatus 10, on the basis of a detection value of a motionsensor, in addition to the determination of whether the informationprocessing apparatus 10 is worn on the left arm or the right arm. As aresult, the device control unit 112, when performing control so that thedisplay is turned on, can display the display screen in a normalorientation. Also, by switching parameters used during state recognitionperformed by the recognition unit 111 according to the orientation(upward or downward) determination, the state of the arm can be morecorrectly recognized.

Also, the left and right determination, parameter changing, and devicecontrol techniques of the present disclosure are applicable to aglasses-type HMD (an example of the information processing apparatus 10)having a display unit corresponding to a left or right lens portion. Forexample, the setting of a parameter used in recognition of a gesture canbe switched on the basis of determination of whether the glasses-typeHMD is worn in front of the left eye or the right eye. Also, the displayof the display unit corresponding to a lens portion is controlled on thebasis of determination of whether the glasses-type HMD is worn in frontof the left eye or the right eye (e.g., a control is performed todetermine whether a command system is to be displayed on the left sideor the right side, etc.).

In addition, the effects described in the present specification aremerely illustrative and demonstrative, and not limitative. In otherwords, the technology according to the present disclosure can exhibitother effects that are evident to those skilled in the art along with orinstead of the effects based on the present specification.

Additionally, the present technology may also be configured as below.

(1)

An information processing apparatus including:

a determination unit configured to determine whether the informationprocessing apparatus is worn on a user's right arm or left arm;

a recognition unit configured to recognize a state of the arm; and

a control unit configured to perform predetermined control on a deviceincluded in the information processing apparatus according to therecognized state of the arm,

wherein the recognition unit switches settings of a parameter which isused in the recognition of the state of the arm, according to a resultof the determination by the determination unit.

(2)

The information processing apparatus according to (1),

wherein the information processing apparatus is a wristwatch device.

(3)

The information processing apparatus according to (1) or (2),

wherein the control unit controls each device according to a usercontext corresponding to the recognized state of the arm.

(4)

The information processing apparatus according to any one of (1) to (3),

wherein the determination unit determines whether the informationprocessing apparatus is worn on the left arm or the right arm, on thebasis of a value acquired by a motion sensor that detects a motion ofthe arm.

(5)

The information processing apparatus according to any one of (1) to (3),

wherein the determination unit determines whether the informationprocessing apparatus is worn on the left arm or the right arm, bymechanical learning using values acquired by a motion sensor thatdetects a motion of the arm.

(6)

The information processing apparatus according to any one of (1) to (3),

wherein the determination unit determines whether the informationprocessing apparatus is worn on the left arm or the right arm, on thebasis of the user's input.

(7)

The information processing apparatus according to any one of (1) to (6),

wherein the recognition unit switches the sign of the parameteraccording to the result of the determination by the determination unit.

(8)

The information processing apparatus according to any one of (1) to (7),

wherein the device included in the information processing apparatus isat least one of a display unit, an operation unit, a motion sensor, aspeaker, a microphone, and an imaging unit.

(9)

A control method including:

determining whether an information processing apparatus is worn on auser's right arm or left arm;

switching settings of a parameter used in recognition of a state of thearm according to a result of the determination, and recognizing thestate of the arm; and

performing predetermined control on a device included in the informationprocessing apparatus according to the recognized state of the arm.

(10)

A program for causing a computer to function as:

a determination unit configured to determine whether an informationprocessing apparatus is worn on a user's right arm or left arm;

a recognition unit configured to recognize a state of the arm; and

a control unit configured to perform predetermined control on a deviceincluded in the information processing apparatus according to therecognized state of the arm,

wherein the recognition unit switches settings of a parameter which isused in the recognition of the state of the arm, according to a resultof the determination by the determination unit.

REFERENCE SIGNS LIST

-   10 information processing apparatus-   11 main control unit-   110 determination unit-   111 recognition unit-   112 device control unit-   12 touch panel display-   13 motion sensor-   14 storage unit-   15, 15 a, 15 b speaker-   16, 16 a, 16 b microphone-   17 communication unit

The invention claimed is:
 1. An information processing apparatuscomprising: circuitry configured to recognize a first state of a deviceheld by a user based on a first value, wherein the first value isdetected from a motion sensor, recognize a second state of the deviceheld by the user based on a second value, wherein the second value isdetected from the motion sensor and the second state is different thanthe first state, recognize that a transition has occurred between thefirst state and the second state, recognize a user context according tothe recognized transition, and perform a control of the informationprocessing apparatus according to the user context, wherein thecircuitry recognizes, as the first state, the device being raised andheld in front of a body of the user, wherein the circuitry recognizes,as the second state, the device being rotated in relation to anorientation of the device while in the first state, and wherein thecircuitry performs the control to switch on a camera function accordingto the transition between the first state and the second state andreturn a display to a previous screen or proceeding to a next screen. 2.The information processing apparatus according to claim 1, wherein thecircuitry is further configured to control the camera function to beoff, when the first state is recognized in which the device is raisedand held in front of the body of the user while a display screen of theinformation processing apparatus is in a viewable state.
 3. Theinformation processing apparatus according to claim 1, wherein thecircuitry is further configured to control a gyroscopic sensor to be on,when the first state is recognized in which the device is raised andheld in front of a body of the user while a display screen of theinformation processing apparatus is in a viewable state.
 4. Theinformation processing apparatus according to claim 1, wherein thecircuitry is further configured to control a gyroscopic sensor to be offand control a sampling rate of an acceleration sensor to be set to ahigher rate than when the gyroscopic sensor is on, when the first stateis recognized in which the device is raised and held in front of a bodyof the user while a display screen of the information processingapparatus is in a viewable state.
 5. The information processingapparatus according to claim 1, wherein the circuitry is furtherconfigured to control a microphone to be on, when the second state isrecognized in which the device is held in the camera shooting position.6. The information processing apparatus according to claim 5, whereinthe microphone is controlled to be on during capturing of a moving imageby the device.
 7. The information processing apparatus according toclaim 5, wherein the microphone is controlled to be off during capturingof a still image by the device.
 8. An information processing apparatuscomprising: circuitry configured to recognize a first state of a deviceheld by a user based on a first value, wherein the first value isdetected from a motion sensor, recognize a second state of the deviceheld by the user based on a second value, wherein the second value isdetected from the motion sensor and the second state is different thanthe first state, recognize that a transition has occurred between thefirst state and the second state, recognize a user context according tothe recognized transition, and perform a control of the informationprocessing apparatus according to the user context, wherein thecircuitry recognizes, as the first state, the device being lowered,wherein the circuitry recognizes, as the second state, the device beingrotated in relation to an orientation of the device while in the firststate, and wherein the circuitry performs the control to switch on acamera function according to the transition between the first state andthe second state and return a display to a previous screen or proceedingto a next screen.
 9. The information processing apparatus according toclaim 8, wherein the circuitry is further configured to control thecamera function to be switched off, when the first state is recognizedin which the device is lowered.
 10. The information processing apparatusaccording to claim 8, wherein the circuitry is further configured tocontrol a microphone to be on, when the second state is recognized inwhich the device is held in the camera shooting position.
 11. Theinformation processing apparatus according to claim 10, wherein thecircuitry is further configured to control a sensitivity of themicrophone to be set to a higher sensitivity when the second state isrecognized in which the device is held in the camera shooting position,than when the second state is not recognized.
 12. The informationprocessing apparatus according to claim 10, wherein the microphone iscontrolled to be on during capturing of a moving image by the device.13. The information processing apparatus according to claim 10, whereinthe microphone is controlled to be off during capturing of a still imageby the device.
 14. The information processing apparatus according toclaim 8, wherein the circuitry is further configured to recognize athird state in which the device is swung, recognize that a transitionhas occurred between the second state and the third state, and perform acontrol to switch a mode from image shooting to moving image shootingaccording to the transition between the second state and the thirdstate.
 15. The information processing apparatus according to claim 8,wherein the circuitry is further configured to control a speaker of theinformation processing apparatus to be off, when the second state isrecognized in which the device is held in the camera shooting position.16. A control method comprising: recognizing a first state of a deviceheld by a user based on a first value, wherein the first value isdetected from a motion sensor; recognizing a second state of the deviceheld by the user based on a second value, wherein the second value isdetected from the motion sensor and the second state is different thanthe first state; recognizing that a transition has occurred between thefirst state and the second state; recognizing a user context accordingto the recognized transition; and performing a control of an informationprocessing apparatus according to the user context, wherein the firststate is recognized in which the device is lowered, wherein the secondstate is recognized in which the device is rotated in relation to anorientation of the device while in the first state, and wherein thecontrol is performed to switch on a camera function according to thetransition between the first state and the second state and return adisplay to a previous screen or proceeding to a next screen.